REMARKS 

Claims 1-15 are all the claims pending in the application. 

Applicant notes that the Examiner has not returned the PTO-1449 form submitted with 
the Information Disclosure Statement filed on March 15, 2001. Applicant is enclosing a copy of 
the above mentioned Information Disclosure Statement, a copy of the PTO-1449 form submitted 
therewith, and the stamped postcard receipt from the PTO indicating that the Information 
Disclosure Statement was received on March 15, 2001 . Accordingly, Applicant respectfully 
requests that the Examiner consider the references listed on the PTO-1449 form and return the 
initialed and signed form with the next Office paper. 

I. Objections to the Drawings 

The Examiner has objected to the drawings for the reasons set forth on page 2 of the 
Office Action. In particular, the Examiner asserts that Figs. 4 and 6 should be labeled as prior 
art. Applicant is submitting herewith replacement sheets for Figs. 4 and 6 which include the ~ 
Prior Art-- label. Accordingly, Applicant kindly requests that the objection be reconsidered and 
withdrawn. 

II. Objections to the Specification 

The Examiner has objected to the specification for the reasons set forth on page 2 of 
the Office Action. Applicant submits herewith a substitute specification and abstract which 
address the Examiner's objections and include various editorial amendments that have been 
made for grammatical and general readability purposes. No new matter has been added. Also 
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enclosed is marked-up copy of the original specification and abstract showing the changes 
incorporated into the substitute specification and abstract. 

Accordingly, Applicant respectfully requests that the Examiner reconsider and withdraw 
the objection to the specification. 

HI. Objections to the Claims 

The Examiner has objected to claims 1-3 for the reasons set forth on page 2 of the Office 
Action. Applicant has amended these claims in a manner to overcome the Examiner's 
objections. Accordingly, Applicant respectfully requests that the objections to the claims be 
reconsidered and withdrawn. 

Applicant notes that in addition to amending claims 1-3 to address the objections, 
claims 1-3 have also been amended for improved clarity and general readability purposes. Such 
amendments do not narrow the scope of the claims and are not made in response to any prior art 
or other rejection. 

IV. Claim Rejections under 35 U.S.C. § 102 

The Examiner has rejected claims 1-3 under 35 U.S.C. § 102(e) as being anticipated by 
Kawabe (U.S. 6,654,510 Bl) . Applicant respectfully traverses this rejection on the following 
basis. 

Applicant submits that the Kawabe reference is not prior art against this application as its 
filing date of September 30, 1999 is subsequent to the application's priority date of July 15, 1999. 
Accompanying this Amendment is a verified English translation of Applicant's priority 
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document, thereby perfecting a claim to priority under 35 U.S.C. § 1 19(a)-(d). Therefore, the 
rejection of claims 1-3 under 35 U.S.C. § 102(e) should be withdrawn. 

V. Allowable Subject Matter 

Applicant thanks the Examiner for indicating that claims 4-15 contain allowable subject 
matter and would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. Applicant notes claims 4-15 have been amended for 
improved clarity and general readability purposes. Such amendments do not narrow the scope of 
the claims and are not made in response to any prior art or other rejection. 

VI. Conclusion 

In view of the above, reconsideration and allowance of this application are now believed 
to be in order, and such actions are hereby solicited. If any points remain in issue which the 
Examiner feels may best be resolved through a personal or telephone interview, the Examiner is 
kindly requested to contact the undersigned at the telephone number listed below. 

Respectfully submitted, 

THE COMMISSIONER IS AUTHORIZED 

TO CHARGE ANY DEFICIENCY \h I THE Shinichi TAKARADA 

FEES FOR THIS PAPER TO DEPOSIT 
ACCOUNT NO. 23-0975 



By: J/iA^n lti"S^CL 



KWF/kes 

Washington, D.C. 20006-1021 
Telephone (202) 721-8200 
Facsimile (202) 721-8250 
July 6, 2004 



Kenneth W. Fields 
Registration No. 52,430 
Attorney for Applicant 
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The present invention relates to an image processor, an 
image processing method and an image processing program 
recording medium and, more particularly, to those which can 
enlarge an image which has tone in each pixel by performing 
resolution conversion with easy arithmetic processing and 
obtain a high-quality resolution image while enlarging the 
same. For example, the present invention ^ relates to those 
which are suitable for being applied in an image output 
apparatus such as a printer for outputting input image 
information b y w i t h interpolating or a display unit for 
performing a screen display equivalent that is equivalent to a_ 
Hi-Vision image display b y w i t h interpolating a current NTSC 
video signal . 

BACKGROUND ART 

Figure 14 i 1 1 u st ra t e s i 1 1 u stra te an example of a condition 
in which the above-mentioned fr h-i-s- type image processor is 
used. In the figure, numeral 1401 denotes a PC(personal 
computer), 1 402 denotes an image processor for enlarging an 
image that is output from the PC, and 1 403 denotes an LCD 
projector for displaying the output of the image processor 
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1 402. 

A video Video signal is output h a v i n a i-n — such as 640 x 
480 pixels from the monitor output line of PC 1401. The 
image processor 1 402 for performing resolution conversion is 
connected between the PC 1401 and the L C D projector 
1 403 them - so as to display the video signal on the LCD 
projector 1403 which has a resolution of such — a-s- 1280x 960 
pixels. 

Thereby, a low-resolution image output from PC 1401 is 
converted to a high-resolution image, and even when an image 
of a PC is subjected to an enlarged projection display on a 
screen by the LCD projector 1403, the projected image is 
prevented from being roughly displayed. 

Various methods have been proposed for resolution 
conversion processing which enlarge a low-resolution image 
b v w4-t4v interpolating. The most common method is a linear 
interpolation for linearly interpolating an intensity of new 
pixels from peripheral original pixels. 

Figure 4 is a diagram showing an interpolation position 
of pixels according to the conventional linear interpolation 
method . 

In figure 4, numeral 401 denotes an original pixel with 
intensity G, 402 denotes an original pixel with intensity H, 
403 denotes an original pixel with intensity I and 404 is an 
original pixel with intensity J. The interval between these 
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original pixels of low-resolution image, that is, the interval 
between adjacent pixels in each of the horizontal or vertical 
directions is "1". Numeral 405 denotes a new pixel with 
intensity K which is obtained by conventional linear 
interpolation. M m" presents the distance from the original 
pixel 401 to the new pixel 405 in the vertical direction, "n" 
presents the distance from the original pixel 401 to the new 
pixel 405 in the horizontal direction, and these distances " m" 
and "n" are assumed to be 0 < m < 1 and 0 < n < 1 . 0-<—m~<z — \ — and 0 <l 

The intensity K of new pixel 405 will be calculated by 
the following equation. 

K = ( 1 -m)(( 1 -n) G + nH) + m ((1-n) I+nJ) 

According to the conventional linear interpolation, it 
performs interpolation by linear interpolation and the required 
operation times for calculating the new pixel is six times of 
multiplication and five times of adding and subtraction. 

In the conventional linear interpolation, there is a 
problem in that an image is smoothed by averaging processing 
with peripheral original pixels, thereby resulting in blurred 
images with the edge parts thereof lacking in sharpness. 

There is an image processor disclosed in the Japanese 
Published Patent Application No. 7-9353 1 which can solve the 
problems that the edge parts of an image is blurred by 
averaging processing. The image processor is the one which 
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performs linear interpolation arithmetic as well as 
performs pe r f o r m i n g smoothing after adding arithmetic 
processing for creating edges in accordance with the condition 
of peripheral images — t h e r e b y T h e r e b y . the edge parts are 
cleared, resulting in high-quality images. 

However, the image processor disclosed in Japanese 
Published Patent Application 7-9353 1 has a problem in that 
the entire processing time is increased as well as the device 
becomes costly when constructed in hardware, because it 
requires an edge making arithmetic processing in addition to 
the linear interpolation. 

Further, when a low-resolution image is interpolated and 
converted to a h i g h - r e so 1 u t i o n image, in particular, to an 
image having twice the n umber of pixels in each of the 
vertical and horizontal directions, the amount of arithmetic 
processing can be reduced by devising the pixel arrangement. 
The arrangement in this case will be described with referring 
to figure 6. 

Figure 6 is a diagram showing a p ixel arrangement 

vv hen af performing resolution conversion to twice the n umber 
of pixels in each of the vertical and horizontal directions by a. 
conventional image processing method. 

In figure 6, " o " designates an original pixel of low- 
resolution image, "a" designates a new pixel of high- 
resolution image. The pixel arrangement in the figure 6 omits 
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arithmetic processing for calculating the intensity of a new 
pixel 604 by matching the position of an original pixel 601 
with the position of new pixel 604, and matching also for their 
intensity. In addition, a new pixel 606 is calculated based 
upon the original pixel 601 and the original pixel 602, and a 
new pixel 610 is calculated based upon new pixels 606, 607, 
608 and 609. 

According to the pixel arrangement in figure 6, though 
the intensity of new pixel 604 which corresponds to the 
original pixel 601 includes no error, the intensity value of new 
pixel 606 which is calculated based upon the original pixels 

601 and 602 may include an error. 5 — f u rther Further , the 

intensity value of new pixel 610 which is calculated based 
upon the new pixel 606 may include a greater error. Thus, 
there arises an interpolation result in which the appearance 
probability of error varies depending on t_h_e__i ntensity of t h e 
new pixeL 

As mentioned above, the conventional image processing 
method for converting a low-resolution image to a high- 
resolution image performs averaging of the intensity of 

original pixels at a p eriphery of a n ew pixel, thereby 

resulting in a problem that an interpolated image is smoothed 
and results in blurred images in which edge parts thereof 
lose j-e-fr-fc- sharpness. 

Further, the image processor disclosed in Japanese 
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Published Patent Application 7-93 53 1 has a problem in that 
the entire processing time becomes longer due to an edge 
making arithmetic processing and a problem in that it becomes 
costly when it is produced in hardware. 

Further, in a case where a pixel arrangement is devised 
so as to decrease the amount of arithmetic processing, there 
may be a case in which the appearance probability of an error 
of pixel data varies depending on pixels. 

The present invention is made to solve the above- 
m e n t i o n e d p roblems and has for its object to provide an image 
processor, an image processing method and an image 
processing program recording medium which can obtain a_ 
high-quality image with sharpness which requires a_ 
decreased amount of interpolation arithmetic so as to 

improve an image resolution, decrease s-h-o-r-t- processing time, 
and provide a small scaled hardware, and further, which can 
make uniform the appearance probability of error of pixel data 
in a case where a pixel arrangement is performed so as to 
minimize the amount of arithmetic processing. 

DISCLOSURE OF INVENTION 

The image processing apparatus according to Claim 1 of 
the present invention provides an image processor which 
converts a low-resolution image to a h i gh - r e so 1 u t i o n image 
that includes a pixel selection means for selecting a pixel of 
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interest which is located at a position closest to a pixel for 
interpolation to be newly generated between pixels 
(hereinafter, simply referred to as "new pixel") and adjacent 
pixels adjacent the pixel of interest from the pixels of the 
low-resolution image, respectively, and new pixeb data 
calculation means for calculating the difference between the 
adjacent pixels putting between the pixel of interest, obtaining 
the amending value on the basis of the difference and the 
distance between the pixel of interest and the new pixel, and 
calculating the data value of the new pixel on the basis of the 
data of the pixel of interest, the difference, and the amending 
value. 

According to the image processor of a first aspect Claim 
4- of the present invention having the above-described 
construction, it is possible to carry out the interpolation of 
image with a small operation amount as well as obtain image 
with sharpness. 

The image processing method according to a second 
aspect Clai m — 2- of the present invention provides an image 
processing method which converts a low-resolution image to a 
high-resolution image that includes a pixel selection step for 
selecting a pixel of interest which is located at a position 
closest to a pixel for interpolation to be newly generated 
between pixels (hereinafter, simply referred to as "new pixel") 
and adjacent pixels adjacent the pixel of interest, respectively, 
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from the pixels of the low-resolution image, and new pixel 
data calculation step for obtaining the difference between the 
adjacent pixels putting between the pixel of interest 
obtaining the amending value on the basis of the difference 
and the distance between the pixel of interest and the new 
pixel, and calculating the data value of the new pixel on the 
basis of the data of the pixel of interest, the difference, and 
the amending value. 

According to the image processing method of the second 
a s p,e c t C 1 a i m — 3- of the present invention having the above- 
described construction, it is possible to carry out the 
interpolation of image with a small operation amount as well 
as obtain an image with sharpness. 

The image processing program recording medium 
according to a third aspec t C la of the present invention has 

stored an image processing program performing conversion of 
a low-resolution image into a high- resolution image therein, 
which program includes a pixel selection step for selecting a 
pixel of interest which is located at a position closest to a 
pixel for interpolation to be newly generated between pixels 
(hereinafter, simply referred to as "new pixel") and adjacent 
pixels adjacent the pixel of interest, from the pixels of the 
lo w- reso I u t ion image, respectively, and new pixel data 
calculation step for obtaining the difference between the 
adjacent pixels putting between the particular pixel, obtaining 
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the amending value on the basis of the difference and the 
distance between the pixel of interest and the new pixel, and 
calculating the data value of the new pixel on the basis of the 
data of the pixel of interest, the difference, and the amending 
value. 

According to the image processing program recording 
medium of the third aspect Claim — 3- of the present invention 
having the above-described construction, it is possible to 
carry out an interpolation of image with a small operation 
amount as well as obtain an image with sharpness. 

The image processor according to a fourth aspect Claim - 
4- of the present invention provides an image processor 
according to the first aspect Clai m — h in which the pixel 
selection means is one which selects data A of the pixel of 
interest of the low-resolution image, located at a position 
closest to a pixel for interpolation to be newly created 
(hereinafter, referred to as "new pixel") between pixels of the 
low-resolution image having distances of "1" between adjacent 
pixels, data B of upper pixel of the low-resolution image 
adjacent the pixel of interest at upper side thereof, data C of 
lower pixel of the low-resolution image adjacent the picture of 
interest at lower side thereof, data D of left pixel of the low- 
resolution image adjacent the pixel of interest at left side 
thereof, and data E of right pixel of the 1 o w - r e s o 1 u t i o n image 
adjacent the pixel of interest at right side thereof, and the new 
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pixel data calculation means is one which calculates data F of 
new pixel composing the high-resolution image by a formula 
of F = A + (i/2) (E-D) + (j/2) (C-B) on the basis of data A of 
pixel of interest, data B of upper pixel, data C of lower pixel, 
data D of left pixel, data E of right pixel, the position of the 
new pixel (i, j) which are represented by a distance "i" in the 
horizontal direction and a distance " j " in the vertical direction 
from the pixel of interest to the new pixel. 

According to the image processor of t h e f o u r t h 
as pect Claim — 4- of the present invention having the above- 
described construction, it is possible to carry out the 
interpolation of image with a small operation amount as well 
as obtain image with sharpness. 

The image processing method according to a fifth 
aspect C4-a 4 m — ■§- of the present invention provides an image 
processing method according to the second aspect Claim — 2- in 
which the pixel selection process is one which selects data A 
of the pixel of interest of the low-resolution image, located at 
a position closest to a pixel for interpolation to be newly 
created (hereinafter, referred to as "new pixel") between 
pixels of the low-resolution image having distances of "1" 
between adjacent pixels, data B of upper pixel of the low- 
resolution image adjacent the pixel of interest at upper side 
thereof, data C of lower pixel of the 1 o w- re so I u t i o n image 
adjacent the pixel of interest at lower side thereof, data D of 
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left pixel of the 1 ow- reso 1 ut ion image adjacent the pixel of 
interest at left side thereof, and data E of right pixel of the 
low-resolution image adjacent the pixel of interest at right 
side thereof, and the new pixel data calculation process is one 
which calculates data F of new pixel composing the high- 
resolution image by a formula of F = A + (i/2) (E-D) + (j/2) (C- 
B) on the basis of data A of pixel of interest, data B of upper 
pixel, data C of lower pixel, data D of left pixel, data E of 
right pixel, the position of the new pixel (i s j) which is 
represented by a distance "i" in the horizontal direction and a 
distance " j " in the vertical direction from the pixel of interest 
to the new pixel. 

According to the image processing method of the fifth 
a s p e c t C 1 a i m — §- of the present invention having the above- 
described construction, it is possible to carry out the 
interpolation of image with a small operation amount as well 
as obtain an image with sharpness. 

The image processing recording medium according to a_ 
sixth aspect Claim — 6- provides an image processing recording 
medium according to Claim 3 in which the pixel selection 
process is one which selects data A of the pixel of interest of 
the low-resolution image, located at a position closest to a 
pixel for interpolation to be newly created (hereinafter, 
referred to as "new pixel") between pixels of the low- 
resolution image having distances of "1" between adjacent 
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pixels, data B of upper pixel of the low-resolution image 
adjacent the pixel of interest at upper side thereof, data C of 
lower pixel of the low-resolution image adjacent the pixel of 
interest at lower side thereof, data D of left pixel of the low- 
resolution image adjacent the pixel of interest at left side 
thereof, and data E of right pixel of the low-resolution image 
adjacent the pixel of interest at right side thereof, and the new 
pixel data calculation process is one which calculates data F 
of new pixel composing the h i gh - re s o 1 u t i o n image by a 
formula of F = A + (i/2) (E-D) + (j/2) (C-B) on the basis of data 
A of pixel of interest, data B of upper pixel, data C of lower 
pixel, data D of left pixel, data E of right pixel, the position 
of the new pixel (i, j) which is represented by a distance "i" in 
the horizontal direction and a distance "j " in the vertical 
direction from the pixel of interest to the new pixel. 

According to the image processing program recording 
medium of the sixth a s p e c t C 1 a i m 6 of the present invention, it 
is possible to carry out an interpolation of image with a small 
operation amount as well as obtain an image with sharpness. 

The image processor according to a seventh aspect Claim 
7- of the present invention provides an image processor 

according to the fourth aspect Claim 4- in which when 

generating the h i gh - re s o 1 u t i o n image having twice number of 
pixels in each of the horizontal and vertical direction for the 
low-resolution image, the position of new pixel is set by 
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making the absolute value of the distance "i" in the horizontal 
direction and that of the distance "j" in the vertical direction 
from the pixel of interest be 1/4, respectively, and the new 
pixel data calculating means is one which, when calculating 
data Fl, F2, F3 and F4 of the new pixel located at upper left, 
upper right, lower left, lower right of the pixel of interest, 
respectively, by F = A + (i/2)(E-D) + (j/2)(C-B), previously 
calculates X = (i/2)(E-D)and Y = (j/2)(C-B) and then calculates 
F1=A-X-Y, F2=A+X-Y, F3=A-X+Y, and F4 = A + X + Y. 

According to the image processor of the seventh 

aspect Claim — 7- of the present invention having the above- 
described construction, it is possible to provide an image 
processor in which, when interpolating the image to twice 
number in the horizontal direction and the vertical direction, 
can make the appearance probability of error of pixel data 
uniform and further realize the interpolation with a small 
operation amount and obtain the image with sharpness. 

The image processing method according to an eighth 
aspect Claim — 8- provides an image processing method according 
t o the fifth aspect Claim 5 in which when generating the high- 
resolution image having twice number of pixels in both the 
horizontal and vertical direction for the low-resolution image, 
the position of new pixel is set by making the absolute values 
of the distance " i " in the horizontal direction and the distance 
"j " in the vertical direction from the pixel of interest be 1/4, 
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respectively, and the new pixel data calculating process is one 
which, when calculating data Fl, F2, F3 and F4 of the new 
pixel located at upper left, upper right, lower left, lower right 
of the pixel of interest, respectively, by F = A+(i/2)(E- 
D) + (j/2)(C-B), previously calculates X = (i/2)(E-D)and 
Y = (j/2)(C-B) and then calculates F1=A-X-Y, F2=A+X-Y, 
F3=A-X+Y, and F4 = A + X + Y. 

According to the image processing method of the eight h 
aspect G 4- a 4 m — 8 of the present invention having the above- 
described construction, it is possible to provide an image 
processing method which can, when interpolating the image to 
twice number both in the horizontal direction and the vertical 
direction, make uniform the appearance probability of error of 
pixel data, and further, can realize the interpolation with a 
small operation amount and can obtain the image with 
sharpness. 

The image ^processing program recording medium 
according to a ninth aspect G4-a4-fH — 9- of the present invention 
provides an image processing recording medium according to 
the sixth aspect Claim 6-, in which when generating the high- 
resolution image having twice number of pixels in both the 
horizontal and vertical direction for the low-resolution image, 
the position of new pixel is made by setting the absolute 
values of the distance M i" in the horizontal direction and the 
distance "j " in the vertical direction from the pixel of interest 
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be 1/4, respectively, and the new pixel data calculating 
process is one which, when calculating data Fl, F2, F3 and F4 
of the new pixel located at upper left, upper right, lower left, 
lower right of the pixel of interest, respectively, by 
F = A + (i/2)(E-D) + (j/2)(C-B), previously calculates X = (i/2)(E- 
D)and Y = (j/2)(C-B) and then calculates F1=A-X-Y, F2=A+X- 
Y, F3-A-X + Y, and F4=A+X+Y. 

According to the image processing program recording 
medium of the ninth aspect €4-a4-m — 9- of the present invention 
having the above-described construction, it is possible to 
provide an image processing program recording medium which 
has recorded a program therein which program, when 
interpolating the image twice number in the horizontal 
direction and the vertical direction, can make uniform the 
appearance probability of error of pixel data, and further, can 
realize the interpolation with a small operation amount and 
can obtain the image with sharpness. 

The image processor according to a tenth aspect Claim- 
4-0- provides an image processor according to the first 
aspect C lai m — h in which the pixel selection means is one which 
selects data A of pixel of interest located at a position closest 
to a pixel for interpolation to be newly generated (hereinafter, 
simply referred to as "new pixel") between pixels of low- 
resolution image having a distance between adjacent pixels 
being "1", data B of upper pixel of low-resolution image 
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adjacent at upper side of the pixel of interest, data C of lower 
pixel of low-resolution image adjacent at lower side of the 
pixel of interest, and the new pixel data calculation means is 
one which calculates data F of the new pixel by a formula of 
F = A+ (j/2) (C-B) on the basis of the data A of pixel of 
interest, data B of upper pixel, data C of lower pixel and the 
distance "j" in the vertical direction from the pixel of interest 
to the new pixel. 

According to the image processor of the tenth 
aspect Claim — of the present invention having the above- 
described construction, it is possible to provide an image 
processor which can interpolate an image in the vertical 
direction with less operation amount and which can obtain a 
high-quality image with sharpness. 

The image processing method according to an eleventh 
asp ect C la i m 1 1 of the present invention provides an image 
processing method according to the second aspect Cloim — 2- i n 
which the pixel selection process is one which selects data A 
of pixel of interest located at a position closest to a pixel for 
interpolation to be newly generated (hereinafter, simply 
referred to as "new pixel") between pixels of low-resolution 
image having a distance between adjacent pixels being " 1", 
data B of upper pixel of low-resolution image adjacent at 
upper side of the pixel of interest, data C of lower pixel of 
low-resolution image adjacent at lower side of the pixel of 
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interest, and the new pixel data calculation process is one 
which calculates data F of the new pixel by a formula of F = A + 
(j/2) (C-B) on the basis of the data A of pixel of interest, data 
B of upper pixel, data C of lower pixel, and the distance " j " in 
the vertical direction from the pixel of interest to the new 
pixel. 

According to the image processing method of the 
eleventh a s p e c t C I a i m — 1-4- of the present invention having the 
above-described construction, it is possible to obtain an image 
processing method which can interpolate an image in the 
vertical direction with a less operation amount and which can 
obtain a high-quality image with sharpness. 

The image processing program recording medium 
according to a t w e 1 f t h aspect Clai m — 1-5- of the present invention 
provides an image processing program recording medium 

according to Lhe__ third aspect Claim — 3- in which the pixel 

selection process is one which selects data A of pixel of 
interest located at a position closest to a pixel for 
interpolation to be newly generated (hereinafter, simply 
referred to as "new pixel") between pixels of low-resolution 
image having a distance between adjacent pixels being "1", 
data B of upper pixel of low-resolution image adjacent at 
upper side of the pixel of interest, data C of lower pixel of 
low-resolution image adjacent at lower side of the pixel of 
interest, and the new pixel data calculation process is one 
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which calculates data F of the new pixel by a formula of 
F = A+ (j/2) (C-B) on the basis of the data A of pixel of 
interest, data B of upper pixel, data C of lower pixel and the 
distance "j " in the vertical direction from the pixel of interest 
to the new pixel . 

According to the image processing program recording 
medium of t he twelfth aspect Clai m — h2- of the present invention 
having the above-described construction, it is possible to 
obtain an image processing program recording medium which 
having recorded a program therein, which program can 
interpolate an image in the vertical direction with a less 
operation amount and which can obtain a high-quality image 
with sharpness. 

The image processor according to a thirteenth 
aspect G4-a 4-m - I - 5- of the present invention provides an image 

processor according to the tenth aspect Claim — l-Q- in which 

when generating the high-resolution image having twice 
number of pixels in the vertical direction for the low- 
resolution image, the position of new pixel is made by setting 
the absolute value of the distance "j" in the vertical direction 
from the pixel of interest be 1/4, and the new pixel data 
calculation means is one which, when calculating data F5 and 
F6 of new pixel which are adjacent at upper and lower of the 
pixel of interest, respectively, by a formula of F = A + (j/2)(C- 
B), calculates Y = (j/2)(C-B) previously, and then calculates 
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F5 = A-X and F6 = A + Y. 

According to the image processor of a thirteenth 
aspect GA aim — ) -3 - of the present invention having the above- 
described construction, it is possible to provide an image 
processor which can, in interpolating an image to twice in the 
vertical direction, make uniform appearance probability of 
error of pixel data, perform interpolation with a less operation 
amount and obtain a high-quality image with sharpness. 

The image processing method according to a fourteenth 
aspect Claim — 1-4- of the present invention provides an image 
processing method according to the eleventh aspect Claim — H-in 
which, when generating h i g h - re so 1 u t i o n image having twice 
number of pixels in the vertical direction for said low- 
resolution image, the position of new pixel is made have the 
absolute value of a distance " j " in the vertical direction from 
the pixel of interest being 1/4, and the new pixel data 
calculation process is one which, when calculating the data F5 
and F6 of the new pixel located at upper and lower of the pixel 
of interest, respectively, by a formula of F = A + (j/2)(C-B), 
previously calculates Y = (j/2)(C-B), and then calculates 
F5=A-X and F6-A+Y. 

According to the image processing method of th e 
fourteenth a s p e c t C 1 a i m 14 of the present invention having the 
above-described construction, it is possible to provide an 
image processing method which, in interpolating an image to 
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twice in the vertical direction, can make uniform appearance 
probability of error of pixel data, and can perform 
interpolation with a less operation amount and obtain a high- 
quality image with sharpness. 

The image processing program recording medium 

according to a fifteenth aspect Claim of the present 

invention provides an image processing program according to 
the twelfth aspect Cl ai m — 1^- in which, when generating the 
high-resolution image having twice number of pixels in the 
vertical direction for the low-resolution image, the position of 
the new pixel is made have the absolute value of a distance "j" 
in the vertical direction from the pixel of interest be 1/4, and 
the new pixel data calculation process is one which, when 
calculating data F5 and F6 of the new pixel located at upper 
and lower of the pixel of interest ^respectively, by a formula 
of F = A + (j/2)(C-B), previously calculates Y = (j/2)(C-B) and 
then calculates F5=A-X and F6 = A + Y. 

According to the image processing program recording 

medium of the fifteenth aspect Claim IS- of the present 

invention having the above-described construction, it is 
possible to provide an image processing program recording 
medium which, in interpolating an image to twice in the 
vertical direction, can make uniform appearance probability of 
error of pixel data, and can perform interpolation with a less 
operation amount and obtain a high-quality image with 
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sharpness. 



BRIEF DESCRIPTION OF DRAWINGS 

Figure 1 is a flow chart showing an operation procedure 
of a calculation procedure of performing resolution conversion 
of S x T pixel image to X x Y pixel image in the image 
processor according to the first embodiment of the present 
invention. 

Figure 2 is a diagram illustrating the position of a new 
pixel which is interpolated by the image processor according 
to the first embodiment of the present invention. 

Figure 3 is a diagram showing the position of a new 
pixel in a case where 700 pieces of original pixels in 1 line 
are interpolated by 1000 new pixels. 

Figure 4 is a diagram illustrating the interpolation 
position of pixels according to the conventional linear 
interpolation. 

Figure 5 is a diagram illustrating the intensity of new 
pixel which is interpolated by the image processor according 
to the first embodiment of the present invention. 

Figure 6 is a diagram illustrating the pixel arrangement 
when the conventional image processing method performs 
resolution conversion to twice the n umber of pixels in the 
horizontal and vertical directions, respectively. 

Figure 7 is a diagram illustrating the position of a_n e w 
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pixel interpolated by the image processor according to the 
second embodiment of the present invention. 

Figure 8 is a flow chart showing a calculation procedure 
for performing resolution conversion from an image of 
horizontal 320 x vertical 240 pixels to horizontal 640 x 
vertical 480 pixels b y w i t h- interpolating to twice the number of 
pixels in the horizontal and vertical directions, respectively, 
in the image processor according to the second embodiment of 
the present invention. 

Figure 9 is a diagram illustrating the position of a_new 
pixel which is interpolated by the image processor according 
to the third embodiment of the present invention. 

Figure 10 is a flow chart showing an operation 
procedure for performing resolution conversion from 
horizontal 320 x vertical 240 pixels to horizontal 320 x 
vertical 480 pixels b.yw-i4+i- interpolating to twice the number of 
pixels in the vertical direction in the image processor 
according to the third embodiment of the present invention. 

Figure 11 is a block diagram showing the construction 
of the image processor according to the first embodiment of 
the present invention. 

Figure 12 is a block diagram showing the construction 
of the image processor according to the second embodiment of 
the present invention. 

Figure 13 is a block diagram showing the construction 
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of the image processor according to the third embodiment of 
the present invention. 

Figure 14 is a diagram showing an example of a 
situation where the image processor as a target of the present 
invention is employed. 

DETAILED DESCRIPTION OF BEST MODE FOR CARRYING 
OW-THE INVENTION 

Hereinafter, the present embodiment will be described 

by w i t h referring to th_e_f igures. The ejni_bo d jm JLO. 1 s described 

herein are embodimen t s h o w n — here — i-s- just examples an example 
and the present invention is not limited to these 
e m bodiments the embodiment . 
(Embod iment 1 ) 

The image processor according to the first embodiment 
of the present invention is one in which conversion of a _J o w - 
resolution image into a^h igh-resolution image is carried out by 
performing interpolating by a simple configuration. 

That is, a pixel of an original image that is closest closet 
to the position of a_n ew pixel for interpolation is taken as a 

pixel of interest, z — fc-h-e- T h e difference between adjacent pixel 

data which are pixels is a pixe4-of the original image which are 
adjacent to each other and putting between the pixel of interest 
is obtained, and the result of multiplication of the ratio 
between the distance between the pixel of interest and the new 
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pixel and the distance between the adjacent pixels and the 
difference is added to the pixel data of the pixel of interest, 
thereby generating the pixel data of the new pixel. 

Figure 2 is a diagram illustrating the position o f the 
new pixel which is interpolated by the image processor 
according to the first embodiment of the present invention. 

In figure 2, numerals 201 through 209 are original 
pixels adjacent to each other in the horizontal or vertical 
direction with a pixel interval of "1". Numeral 210 denotes a 

new pixel which is generated by interpolating a low-resolution 

image, whose intensity is represented by F. Numeral 205 
denotes a pixel of interest which is the closest to new pixel 
210, which has intensity A. Numerals 202, 208, 204 and 206 

denote an upper pixel, a lower pixel, and a left pixel, 

respectively, which are adjacent to the pixel of interest 205, 
and are situated at an upper side, a_Jower side, a left-hand 
side, and a^r ight-hand side, respectively, with relative to the 
pixel of interest 205, and which are adjacent to the pixel of 
interest 205 and have intensity B, C, D and E, respectively. 
Further, "i H denotes the distance between pixel of interest 205 
and new pixel 210 in the horizontal direction, and "j" presents 
the distance between pixel of interest 205 and new pixel 210 
in the vertical direction, and right hand direction and 
downward direction are assumed to be positive. 

The intensity F of new pixel 210 is calculated by the 
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formula of 

F = A + (i/2)(E-D) + (j/2)(C-B). 

Because the interpolation point is previously known in 
this formula, (i/2) and (j/2) can be provided as constants 
beforehand, and therefore, the number of times of operation 
required for calculating the intensity F requires two 
times t wice of multiplication and four times of addition or 
subtraction for calculating the intensity F. On the contrary, 
the conventional linear interpolation requires six times of 
multiplication and five times of addition or subtraction for 
calculating the intensity of a_n e w pixel . , thereby ! hereby, the 
image processor according to the first embodiment of the 
present invention requires less calculation amount than the 
conventional linear interpolation. 

Next, intensity F of new pixel 210 will be briefly 
described byw-k-h- taking the horizontal direction of figure 2 as 
an example. 

Figure 5 is a diagram illustrating the intensity of the 
new pixel which is interpolated by the image processor 
according to the first embodiment of the present invention. 

Here, a simple assumption is taken for interpolating. 
Hereinafter, the assumption will be described bvw44h- referring 
to figure 5. Figure 5 is a diagram illustrating an image 
interpolation model. For simplification, the image is 
represented in one-dimension and broadening of an image is 
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presented in the horizontal direction while intensity of the 
image is presented in the vertical direction. 

In figure 5, the ordinate represents an p-p-e-s-enrt-s — a- 
intensity and the abscissas represents presents the distance in 
the horizontal direction in figure 2. Numerals 204, 205, 206, 
210 and i denote the same elements as shown in figure 2. 
Numeral 501 denotes an a- intensity curved line (actually, 
intensity curved plane) of a_low-resolution image, 502 denotes 
a line representing fi^-e-s-e-n-t+n-g- positions which are apart only by 
the distance " i " from a pixel of interest 205, 503 denotes a 
line connecting an original pixel 204 and an original pixel 
206, 504 denotes a line which is parallel with line 5 0 3 5 0 6 and 
connects a pixel of interest 205 and a new pixel 210, 505 

denotes the pixel interval of a 1 ow-resolution image, 506 

denotes a line connecting a pixel of interest 205 and an 
original pixel 206, 507 denotes a crossing point of line 502 
and line 506, which is a new pixel interpolated by the 
conventional linear interpolation. Further, numeral 509 
denotes the distance between original pixel 204 and original 
pixel 206. 

In order to clarify the difference with the conventional 
linear interpolation, the intensity D, A and E of original 
pixels 204, 205 and 206 are assumed to be D<E< A . 

When numeral 501 denotes an original intensity curved 
li ne of an image, it is assumed that original image pixels are 
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sampled at even intervals in the horizontal direction such as 
204, 205 and 206. At this time, the interpolation data at the 
interpolated points on a straight line 502 are assumed to be 
obtained. 

As a reference, in a case where linear interpolation is 
performed, the crossing point of straight line 506 connecting 
pixel 205 and pixel 206 and straight line 502 becomes an 
interpolation data. In contrast thereto, the intersection point 
of a tangent of intensity curved line at the position of pixel 
205 and straight line 502 is assumed to be an interpolation 
data in the first embodiment of the present invention. Further, 
approximately, the gradient of a tangent at pixel 205 is 
assured to be equal to the gradient of straight line 503 
connecting pixel 204 and pixel 206. According to this 
assumption, the straight line 504 having the same inclination 
as the straight line 503, and which passes through the pixel 
205 can be obtained, and further, new pixel 210 as 
interpolated data can be obtained at the crossing point of the 
straight line 504 and the straight line 502. 

By assuming as above, the process is actually performed 
such that the intensity of the pixel 204 is subtracted from that 
of the pixel 206, the result is multiplied by a ratio between 
the distance " i " and the distance 509, and the result is added 
to the intensity of pixel 205 ,_ 5 — the re by There by, it becomes 
possible to obtain an interpolation result by quite an easy 
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processing. 

In order to produce an actual formula, when the 
intensity of pixel 204 is assumed to be " D", the intensity of 
pixel 205 be "A", the intensity of pixel 206 be "E", the 
distance 509 be "2" ( = twice as the interval of abutted pixels 
"1") and the distance 510 be "i", the intensity F of the pixel 
2 10 is given by 

F = A + (i/2)(E-D), 
which is quite a simple formula requiring only one time 
multiplication and two times addition or subtraction. 

As shown in figure 5, while the intensity of new pixel 
507 which is interpolated by the conventional linear 
interpolation amounts to the average of intensity A and E, the 
image processor according to the first embodiment can obtain 
a h igh-quality image with sharpness since the intensity of new 
pixel 210 which is interpolated by the image processor is not 
limited to be b etween the intensity A and F. 

Figure 11 is a block diagram showing the construction 
of the image processor according to the first embodiment. 

In figure 11, numeral 1131 denotes a line memory means 
which is configured as follows. 

To be specific, numeral 1101 denotes a lower line 

memory which receives as its input a 1 ow-resolution image 

sequentially from an original pixel data at an u pper end of a. 
frame, 1102 denotes a middle line memory which receives as 
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its input the output of lower line memory 1101, and 1103 
denotes an upper line memory which receives as its input the 
output of middle line memory 1102 , ^-e-h- B a c h line memory 
has a storage capacity for storing the original pixels of low- 
resolution image up to 1 line in the horizontal direction, and it 
outputs the oldest data of 1 pixel among stored data if one 
pixel data is input when the memory storage is filled. Further, 
1105 denotes an upper end processing path for copying 
instantaneously the data which is stored in the middle line 
memory 1102 to the upper line memory 1103 at the frame 
upper end processing, and 1104 denotes a lower end processing 
path for instantaneously copying the data which is stored in 
the middle line memory 1102 to the lower line memory 1101 at 
the f ram e f 1 am e lower end processing. 

Further, numeral 1132 denotes a data buffer means that 
is configured as follows. 

To be specific, numeral 1107 denotes a right pixel data 
buffer, 1108 denotes a pixel of interest data buffer, 1109 
denotes a left pixel data buffer, 1110 denotes a lower right 
pixel data buffer, 1111 denotes a lower pixel data buffer, 1112 
denotes an upper right pixel data buffer^ and 1113 denotes an 
upper pixel data buffer.^ — e^-lv Each data buffer is a storage 
capacity for storing a data of 1 pixel temporarily, and 
o u t p u I s e-tt-frp-ta-fc- the data which is stored beforehand when the 
data of 1 pixel is input. Further, numeral 1106 denotes a left 
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end processing path for copying instantaneously the data 
which is stored in the pixel of interest data buffer 1108 to the 
left pixel data buffer 1109 at a f ram e f-l-a-we left end 
processing. 

Further, numeral 1130 denotes a pixel selection means 
that is constructed by the a- line memory means 1131 and the a- 
data buffer means 1132. 

Further, numeral 1133 denotes a new pixel data 
arithmetic means for obtaining the data of a_n ew pixel that is 
constructed as follows. 

To be specific, numeral 1114 denotes a horizontal 
subtracter for obtaining the difference in the horizontal 
direction, 1115 denotes a vertical subtracter for obtaining the 
difference in the vertical direction, 1116 denotes a horizontal 
arithmetic device for obtaining the correction value in the 
horizontal direction, 1117 denotes a vertical calculator for 
obtaining the correction value in the vertical direction, and 
1134 denotes a new pixel data calculator for obtaining the data 
of ne w pixe 1 . 

Hereinafter, the distance from a pixel of interest to a_ 
new pixel will be described by one dimension for 
simplification. 

Figure 3 is a diagram illustrating the position of a__n e w 
pixel in a case where 700 pieces of original pixels i n o n e line 
are interpolated by 1000 pieces of new pixels. 
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In figure 3, numeral 301 denotes an axis representing a. 
horizontal direction of the frame fla m e, and pO, pi, p2 and p3 
denote original pixels which represent the positions on the 
axis 301 by employing an arrow, respectively, and assumes the 
pixel interval to be "1". The qO, ql, q2 and q3 denote new 
pixels which represent the positions on the axis 301 employing 

an arrow, respectively, - — e a c h E a c h figure in 

paranthcses p-a-^e-n4# e si s is a pixel position which is represented 
by the distance from the original pixel pO. 

Numeral 302 denotes the position of a n ew pixel which 

is represented by a form dividing the distance from the 
original pixel pO into an integral part and a decimal part, and 
the integral part represents presents the position of a pixel of 
interest against the new pixel and the decimal part 
represents pr-es-a-n-t -s- the distance from a pixel of interest to the 
new pixel in such a manner that the absolute value of t h e 
decimal part does not exceed a threshold of 0.5. For instance, 
new pixel q3 has a distance from the original pixel pO of b-e-i-R-g- 
2.1, and dividing the same into an integral part and a decimal 
part not exceeding 0.5, results in 2 + 0.1, which means the pixel 
of interest against new pixel q3 is the original pixel p2, and 
the distance from the original pixel p2 to new pixel q3 is 0.1. 
Further, new pixel ql has a distance from the original pixel pO 
o fb&i&fr 0.7, and dividing the same into an integral part and a 
decimal part not exceeding 0.5, results in 1-0.3, which means 
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the pixel of interest against new pixel ql is the original pixel 
pi and the distance from the original pixel pi to new pixel ql 
is -0.3. 

Numeral 303 denotes the position of a _n ew pixel, which 
i s represented p re sented by scaling the decimal part of the 
position 302 into 1/2. In the actual interpolation calculation, 
the distance " i " and "j " from the pixel of interest to the new 
pixel is scaled into 1/2 to be employed for the calculation, the 
decimal part is scaled into 1/2 beforehand, and the integral 
part and the decimal part are divided with the absolute value 

of the decimal part not exceeding a threshold of 0.25. 

Further, the threshold value is obtained by multiplying 0.5 on 
the size of scaling. 

Hereinafter, the operation of line memory means 1131 
and data buffer means 1132 will be described. 

Firstly, the basic operation will be described. This is a 
case where frame flame end processing (described later) is not 
re lated . 

When it has no relation to f ram e f 1 am e end processing, 
the line memory means 1131 and the data buffer means 1132 
stores data of each full storage capacity. 

Here, the lower line memory 1101 receives as its input 
data of 1 pixel from the outside and outputs output - the oldest 
data of 1 pixel among stored data to the middle line memory 
1102 and the lower right pixel data buffer 1110. Further, the 
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middle line memory 1102 receives as its input the data of 1 
pixel from the lower line memory 1101 and outputs output the 
oldest data of 1 pixel among stored data to the upper line 
memory 1103 and the right pixel data buffer 1107. Further, 
the upper line memory 1103 receives as its input the data of 1 
pixel from the middle line memory 1102 and outputs e-t*4-ff u-i- t h e 
oldest data of 1 pixel among stored data to the upper right 
pixel data buffer 1112. 

Further, the lower right pixel data buffer 1110 receives 
as its input the data of 1 pixel from the lower line memory 
110 1 and outputs output the data of 1 pixel to the lower pixel 
data buffer 1111. Further, the lower pixel data buffer 1111 
receives as its input the data of 1 pixel from the lower right 
pixel data buffer 1110 and outputs output the data of 1 pixel to 
the vertical subtracter 1115. 

Further, the right pixel data buffer 1107 receives as its 
input the data of 1 pixel from the middle line memory 1102 
and o u t p u t s o u t p-i*4- the data of 1 pixel to the pixel of interest 
data buffer 1108 and the horizontal subtracter 1114. Further, 
the pixel of interest data buffer 1108 receives as its input the 
data of 1 pixel from the right pixel data buffer 1107 and 
outputs e-utf-u4 the data of 1 pixel to the left pixel data buffer 
1109 and new pixel data calculator 1134. The left pixel data 
buffer 1109 receives as its input the data of 1 pixel from the 
pixel of interest data buffer 1108 and outputs output the data 
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of 1 pixel to the horizontal subtracter 1114. 

Further, the upper right pixel data buffer 1112 receives 
as its input the data of 1 pixel from the upper line memory 
110 3 and outputs output the data of 1 pixel to the upper pixel 
data buffer 1113. The upper pixel data buffer 1113 receives as 
its input the data of 1 pixel from the upper right pixel data 
buffer 1112 and outputs output the data of 1 pixel to the 
vertical subtracter 1115. 

Accordingly, if the data of a___P ixel can be obtained by 
scanning 1 line from the left-hand side toward the ri ght-hand 
side of the image and each line sequentially from the upper 
side toward the lower side of the image, the highest line 
among three lines could be stored in the upper line memory 
1103 in which a line data which is first input is stored among 
three line memories 1101,1102 and 1103, the highest line 
among three lines is stored among three lines is stored. In 
addition, in the upper right pixel data buffer 1112 in which the 
pixel data which is first input is stored among two data 
bu ffers buffe r 1112 and 1113, the pixel data which is 
positioned at the left-side among two pixel data is stored. 

Accordingly, in the data buffer 1107 or 1113 in the data 
buffer means 1132 in figure 11, a right pixel, a pixel of 
interest, a left pixel, a right lower pixel, a lower pixel, an 
upper right pixel and an upper pixel are stored with locating 
the pixel of interest data buffer 1108 at their center. Thereby, 
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the storing of pixel arrangement shown in figure 2 is realized. 

Hereinafter, four f ram e f 1 am e end processing will be 
described. 

Firstly, the operation of frame flame upper end 
processing will be described. 

Since there is no pixel which is adjacent the pixel of 
interest at the upper side thereof in a case where a pixel of 
interest is a pixel of a frame flame upper end, the frame f I ame 
upper end processing performs pixel interpolation b y with- 
copying the data of pixel of interest thereto. Further, the 
frame flame upper end processing performs, when the lower 
line memory 1101 receives the vertical synchronous signal 
indicating the beginning of a frame flame , the following 
operation. 

When the data of a p ixel on the second line is input 

after storing all pixel data of the first one line, the lower line 
memory 1101 outputs stored pixel data of the first one to the 
middle line memory 1102 without outputting to the right pixel 
data buffer 1110. Then, the lower line memory 1101 stores all 
pixel data of the second line, and the middle line memory 1102 
stores all pixel data of the first line. 

Then, the upper end processing path 1105 copies all 
pixel data of the second line which i sa-^e- stored in the middle 
line memory 1102 to the upper line memory 1103. The upper 
line memory 1103 stores all pixel data of the first line, and 
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thereafter, the line memory means 1131 performs a basic 
operation . 

Secondly, a f ram ef -l-a-me lower end processing will be 
described . 

Since there is no pixel which is adjacent to the pixel of 
interest at the lower side thereof in a case where the pixel of 
interest is a pixel of a frame flame lower end, the frame flamc 
lower end processing performs pixel interpolation b v w+t-h- 
copying the data of a pixel of interest thereto. Further, the 
frame lower end processing performs, when the lower line 
memory 1101 receives a vertical synchronous signal indicating 
the end of a frame 

The lower line memory 1101 which receives as its input 
the data of a__p ixel of the last line output stored data of a__p i x e 1 
of the last line one by one pixel during the vertical 
synchronous signal. Thereafter, the data which is stored in 
the lower line memory 1101 is lost, and the middle line 
memory 1102 stores all pixel data of the last line. 

The lower end processing path 1104 copies the pixel 
data of the last line which is stored in the middle line memory 
1102 to the lower line memory 1101. Then, the lower line 
memory 1101 stores the pixel data of the last line, and 
thereafter, the line memory means 1131 performs a basic 
operation. 

Thirdly, a frame flamc left end processing will be 
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described. 

The frame flame left end processing performs, when the 
pixel of interest is a pixel of a f r a m e f- 1-a-m -e- left end which has 
no pixel adjacent to the pixel of interest at a_Jeft side thereof, 

pixel interpolation h y w i t h copying the data of a pixel of 

interest thereto. Further, the front left end processing 

performs, when the pixel of interest data buffer 1108 receives 
a horizontal synchronous signal indicating the beginning of 
the line, the following operation. 

The pixel of interest data buffer 1108 which received a 
horizontal synchronous signal indicating the beginning of the 
line stores the data of the first pixel. Next, the left end 
processing path 1106 copies the data of the first pixel which is 
stored in the pixel of interest data buffer 1 108 to the left pixel 
data buffer 1109. Then, the left pixel data buffer 1109 stores 
the first pixel data of each line, and thereafter, the data 
buffer means 1132 performs a basic operation. 

Fourthly, a frame flame right end processing will be 
described. 

The frame flame right end processing performs, when the 
pixel of interest is a pixel of a frame flam e right end which has 

no pixel adjacent to the pixel of interest at a right side 

thereof, pixel interpolation by w-k-h- copying the data of a pixel 
of interest thereto. Further, the frame flam e end processing 
performs, when the lower line memory 1101 receives a 
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horizontal synchronous signal indicating the end of the line, 
the following operation. 

Due to t h ~a4 — t he line memory means 1131 w -e u4-d not 
shifting s hi ft data during the horizontal synchronous signal 
indicating the end of the line, the data would not be shifted 
from the line memory means 1131 to the data buffer means 
1 132. 

Here, the right pixel data buffer 1107 copies the stored 
pixel data of the line end to the pixel of interest data buffer 
1108, and the lower right pixel data buffer 1110 and the upper 
right pixel data buffer 1112 output stored pixel data of the 
line end to the lower pixel data buffer 1111 and the upper 
pixel data buffer 1113, respectively. Both the right pixel data 
buffer 1107 and the pixel of interest data buffer 1108 can 
store the data of the pixel of interest at the right end of the 
f r a m e and the left pixel data buffer 1109 can store the 

pixel data which is adjacent to the pixel of interest at the left 
side thereof, and the upper pixel data buffer 1113 and the 
lower pixel data buffer 1111 can store the pixel data which is 
adjacent to the pixel of interest at the upper and the lower 
side thereof, respectively, and thereafter, the line memory 
means 1131 and the data buffer means 1132 performs basic 
operations. 

According to these four frame flame end processing, 
even when a pixel of interest is situated at the end part of 
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flame which does not have an adjacent pixel at any side of the 
pixel of interest, the adjacent pixel value could be filled with 

the value of a pixel of interest, thereby resulting in a_ 

capability of calculating new pixel data. 

In this way, the line memory means 1131 and the data 
buffer means 1132 can store the data of pixel of interest into 
the pixel of interest data buffer 1108 and store the data of 
pixels which are adjacent to the upper, the lower, the left side, 
and the right side of the target pixel into the upper pixel data 
buffer 1113, the lower pixel data buffer 1111, the left pixel 
data buffer 1109 and the right pixel data buffer 1107, 
respectively, by basic operations for shifting the data of a_ 
pixel which is input from the outside one by one, and four 
frame flame end processing. 

Next, an operation of the arithmetic means 1133 will be 
described . 

The horizontal subtracter 1114 receives as its input the 
right pixel data from the right pixel data buffer 1107 and the 
left pixel data from the left pixel data buffer 1109, and 
subtracts the left pixel data from the right pixel data, and 
output s o - u - t -p- u - t - the difference in the horizontal direction to the 
horizontal arithmetic device 1116. The horizontal arithmetic 
device 1116 multiples (coefficient 1/2), (the distance in 
horizontal direction from a p ixel of interest to a_n e w pixel) 
and (the difference in a_h orizontal direction), and outputs the 
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horizontal correction value to new pixel data calculator 1134. 
The vertical subtracter 1115 receives as its inputs the lower 
pixel data from the lower pixel data buffer 1111 and the upper 
pixel data from the upper pixel data buffer 1113, and subtracts 
the upper pixel data from the lower pixel data, and 

outputs output the difference in a v ertical direction to the 

vertical arithmetic device 1117. The vertical arithmetic 
device 1117 multiples (coefficient 1/2), (the distance in 
vertical direction from a__p ixel of interest to a_n ew pixel) and 

(the difference in a v ertical direction), and outputs the 

vertical correction value to new pixel data calculator 1134. 
The new pixel data calculator 1134 receives as its input the 
data of a pixel of interest from the pixel of interest data 
buffer 1108, and adds (the data of the pixel of interest), 
(horizontal correction value ) and (vertical correction value), 
and output the new pixel data. 

Next, an operation procedure of the operation means 
1133 will be described byw4^h- referring to figure 1. 

Figure 1 is a flow chart showing an operation procedure 
for performing resolution conversion of an image of S x T 
pixels to that of X x Y pixels. 

In figure 1, S denotes a pixel number of a low- 
resolution image in the horizontal direction, T denotes a pixel 
number of a_J ow-resolution image in the vertical direction, X 
denotes a pixel number of a high-resolution image in the 
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horizontal direction, Y denotes a pixel number of a h i g h - 

resolution image in the vertical direction, px denotes a 
horizontal pitch, py denotes a vertical pitch, yy denotes a 
position of pixel of interest in the vertical direction, b 
denotes a vertical coefficient, 1 denotes a vertical loop 

counter, xx denotes a position of a p ixel of interest in the 

horizontal direction, a denotes a horizontal coefficient, k 
denotes a horizontal loop counter, Q [ k , 1 ] denotes an a- intensity 
at the position of new pixel [k,l], P[xx,yy] denotes ana- 
intensity at the position of original pixel [xx,yy], and there 
are relations of 0<S<X, 0<T<Y,0<k<X, 0<KY,0<xx<S, and 
0<yy<T. 

5101 denotes a p i tch-calcu lat i ng. step for calculating the 

pitch of a new pixel in each of the horizontal and vertical 

directions. The horizontal pitch px is calculated by S/X/2, 
and the vertical pitch py is calculated by T/Y/2. 

5102 denotes a vertical loop default setting up step for 
setting initial values for variables concerning the vertical 
loop, and it assigns the initial value "0" to the position yy in 
the vertical direction of the pixel of interest, the vertical 
coefficient b, and the vertical loop counter 1, respectively. 

5103 denotes a horizontal loop default setting up step 
for setting initial values for variables concerning the 
horizontal loop, and it assigns the initial value "0" to the 
position xx in the horizontal direction of the pixel of interest, 
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the horizontal coefficient a, and the horizontal loop counter k, 
respectively. 

5104 denotes a n a- intensity calculating step for 
calculating the intensity of the n ew pixel and the intensity of 
new pixel Q [k,l] is calculated by 

Q[k,l] = P[xx,yy]+a(P[xx+l,yy]-P[xx-l,yy]) 
+ b(P[xx,yy+l]-P[xx,yy-l]). 

5105 denotes a horizontal coefficient calculating step 

for calculating a new horizontal coefficient, and it is 

calculated by adding the horizontal pitch px to the horizontal 
coefficient a. 

5106 denotes a horizontal coefficient threshold 
comparison step for comparing the horizontal coefficient with 
a t hreshold value 0.25, and, in accordance with the comparison 
result, it proceeds to step S108 when the horizontal coefficient 
a is smaller than or equal to the threshold value, while it 
proceeds to step S107 when it is larger than the threshold 
value. 

5107 denotes a pixel of interest right shifting step for 
shifting the pixel of interest toward the right direction, and 
the position of pixel of interest in the horizontal direction is 
shifted by xx = xx+l, and the horizontal coefficient is shifted 
by a = a - 0 . 5 . 

5108 denotes a horizontal loop conclusion judging step 
for judging the conclusion of a horizontal loop which is 
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repeated from step S104 through S108, and it compares new 
horizontal loop counter k which is obtained by adding 1 to the 
pixel number X in the h orizontal direction of the h i g h - 
resolution image, and, in accordance with the comparison 
result, it proceeds to step S104 when new horizontal loop 
counter k is smaller than X, while it proceeds to step S109 
when it is equal to X. 

5109 denotes a vertical coe ff i c i e n t -c a! c u 1 a t i n g step for 
calculating a new vertical coefficient, and it is calculated by 
adding the vertical pitch py to the vertical coefficient b. 

5110 denotes a vertical coefficient threshold comparison 
step for comparing the vertical coefficient with threshold 
value 0.25, and, in accordance with the comparison result, it 
proceeds to step SI 12 when the vertical coefficient b is 
smaller than or equal to the threshold value, while it proceeds 
to step Sill when it is larger than the threshold value. 

5111 denotes a pixel of interest downward shifting step 
for shifting the pixel of interest in a_d ownward direction, and 
the position of the pixel of interest in the vertical direction is 
shifted by yy = yy-M, and the vertical coefficient is shifted by 
b = b-0.5. 

S 1 1 2 denotes a vertical loop conclusion judging step for 

judging the conclusion of a v ertical loop which is repeated 

from step S103 through S112, and it compares new vertical 
loop counter 1, which is obtained by adding "1" to the vertical 
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loop counter 1, with the pixel number Y in vertical direction 
of high-resolution image, and, in accordance with the 
comparison result, it proceeds to step S103 when new vertical 
loop counter 1 is smaller than Y, while it terminates pixel 
interpolation of an image when it is equal to Y. 

In the image processor according to the first 
embodiment of the invention, the image processor for 
converting a_J ow-resolution image to a h igh-resolution image 
b v w -i t-h interpolating the low-resolution image includes a pixel 
selection means 1130 for extracting a pixel of interest, an 
upper pixel, a lower pixel, a left pixel and a right pixel, the 
vertical subtracter 1115 for calculating the difference in the 
vertical direction on the basis of the upper and lower pixel 
data, the horizontal subtracter 1114 for calculating the 
difference in the horizontal direction on the basis of the left 
and right pixel data, the vertical arithmetic device 1117 for 
calculating the vertical correction value on the basis of the 
difference in the vertical direction and the distance from a 
pixel of interest to a new pixel in the vertical direction, the 
horizontal arithmetic device 1116 for calculating the 
horizontal correction value on the basis of the difference in 
the h orizontal direction, and the distance from a pixel of 
interest to a new pixel in the vertical direction, and the new 
pixel data calculator 1134 for calculating the new pixel data 
on the basis of data of a pixel of interest, the vertical 
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correction value, and the horizontal correction value, and 
further, the intensity F is calculated by F = A + ( i 12 ) ( E - 
D) + (j/2)(C-B) on the basis of intensity A of the pixel of 
interest, the intensity B of the u pper pixel, the intensity C of 
the lower pixel, the intensity D of the left pixel, the intensity 
E of t h e r ight pixel and the position (i, j) of the n e w pixel. 
Thereby, it is possible to reduce an operation amount for 
interpolating images and to improve m-ft-r o v e the processing 
speed, and further, a high-quality image with sharpness is 
obtained without smoothing an edge part of image. 
(Embodiment 2) 

The image processor according to a second embodiment 
is one which converts a low-resolution image of horizontal 320 
x vertical 240 pixels to a high-resolution image of horizontal 
640 xvertical 480 pixels b v w44-h- interpolating to twice th e 
number of pixels in each of the horizontal and vertical 
directions, and one which is limited to interpolation to twice 
the number in the vertical and horizontal directions which are 
well employed in resolution conversion processing so as to 
suppress an a rithmetic operation amount to the minimum. 

Figure 12 is a block diagram showing the construction 
of the image processor according to the second embodiment. 

In figure 12, like reference characters as figure 11 
designate the same parts, 1233 denotes new pixel data 
arithmetic means and is constructed as follows. 



45 



To be specific, 1114 and 1115 denote de note s the same 
elements as those in figure 11, 1216 denotes a horizontal 
arithmetic device for obtaining the horizontal correction value 
by shifting the difference in the horizontal direction leftward 
by 3 bits b-H- so as to make the same to 1/8, 1217 denotes a 
vertical arithmetic device for obtaining the vertical correction 
value by shifting the difference in the vertical direction by 3 
b i l s b-k- so as to make to 1/8, 1218 denotes an upper left new 

pixel data calculator for calculating the data of a n e w pixel 

for interpolation at an upper left of a pixel of interest, 1219 
denotes an upper right new pixel data calculator for 
calculating the data of the n ew pixel for interpolation at ajn. 
upper right of the pixel of interest, 1 220 denotes a lower left 
new pixel data calculator for calculating the data of the new 
pixel for interpolation at a_lower left of the pixel of interest, 
1221 denotes a lower right new pixel data calculator for 
calculating the data of the n ew pixel for interpolation at a 
lower right of the pixel of interest. Further, 1 2 3 5 denotes a 
new pixel data calculator which is constructed by the upper 
left new pixel data calculator 1218, the upper right new pixel 
data calculator 1219, the lower left new pixel data calculator 
1220, and the lower right new pixel data calculator 1221. 

Further, 1234 is a maintenance means, and is 
constructed as follows. 

1222 denotes an upper new pixel line memory for 
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storing the data of the new pixel which is situated at the upper 
o f the p ixel of interest by 1 line of high-resolution image, 
1223 denotes a lower new pixel line memory for storing the 
data of new pixel which is situated at the lower of t he pixel of 
interest by 1 line of high-resolution image. 

Figure 7 is a diagram illustrating the position of the 
new pixel which is interpolated by the image processor 
according to the embodiment of the present invention. 

In figure 7, "o" denotes an original pixel of low- 
resolution image having a pixel interval of "1", "□" denotes a 
new pixel of h i gh -re s o 1 ut i o n image. Further, new pixels do 
not match with the position of the original pixel, but are 
positioned at points which are distant from the original pixels 
by the distances the absolute values of which are 1/4 in both 
the horizontal and vertical directions. The intensity of the 
original pixels of 70 1,702,703,704 and 705 and the new pixels 
of 706,707,708,709 are designated as P701, P702, P703, P704, 
P705, Q706, Q707, Q708 and Q709, respectively. 

According to this pixel arrangement, since all the new 
pixels are arranged at equal intervals from the original pixels, 
the appearance probability of the error of pixel data becomes 
uniform. However, in this arrangement, the operation amount 
will increase because it is necessary to create all of the new 
pixels. In this second embodiment, utilizing the nature that 
the distances from the original pixel are all equal, the 
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calculation amount can be suppressed. 

To be specific, if difx - ( 1 /8)(P705 -P704), difx - 
( 1 /8)(P703-P702) are first calculated on the basis of original 
pixels 701, 702, 703, 704 and 705, the arithmetic expression 
for calculating the intensity of new pixels Q706, Q707, Q708, 
Q709, becomes as follows, 

Q706 = P70 1 -difx-dify 

Q707 = P70 1 +difx-dify 

Q708 = P701-difx + dify 

Q709-P70 1 + difx + dify 
and, the number of times required for obtaining the intensity 
Q706 through Q709 of four new pixels from the intensity P701 
of one pixel of interest are only ten times addition or 
subtraction and two times division. 

In addition, if the calculation of P701-difx and 
P701+difx are shared, the intensity of four new pixels can be 
obtained by eight times addition and subtraction and two 
times division. 

Next, the operation will be described. 

The horizontal subtracter 1114 receives as its inputs the 
data of a__right pixel from the right pixel data buffer 1107 and 

the data of a left pixel from the left pixel data buffer 1109, 

and subtracts the data of the left pixel from the data of the 
right pixel, and outputs e-u-^p-u4- the difference in the horizontal 
direction to the horizontal arithmetic device 1216. The 
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horizontal arithmetic device 1216 shifts the difference in the 
horizontal direction toward leftward to 1/8 and outputs the 
horizontal correction value to the upper left new pixel data 
calculator 1218, the upper right new pixel data calculator 
1219, the lower left new pixel data calculator 1 220, and the 
upper right new pixel data calculator 1221. Further, the 
vertical subtracter 1115 receives as its inputs the data of the 
lower pixel from the lower pixel data buffer 1111 and 
i n p u t s Hi-fH*-t~ the data of upper pixel from the upper pixel data 
buffer 1113, and subtracts the data of the u pper pixel from the 
data of the 1 ower pixel, and outputs ou t p u t the difference in the 
vertical direction to the vertical arithmetic device 1217. The 
vertical arithmetic device 1217 shifts the difference in the 
vertical direction t o w a r d — leftward to 1/8 and outputs the 
vertical correction value to the upper left new pixel data 
calculator 1218, the upper right new pixel data calculator 
1219, the lower left new pixel data calculator 1220 and the 
upper right new pixel data calculator 1221. 

The upper left new pixel data calculator 1218 receives 
as its input the vertical correction value from the vertical 
arithmetic device 1217, the horizontal correction value from 
the horizontal arithmetic device 1216, and the data of the 
pixel of interest from the pixel of interest data buffer 1108, 
respectively, and then subtracts the vertical correction value 
and the horizontal correction value from the data of the p i x e 1 
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of interest and outputs output the data of the new pixel to be 
interpolated to the upper new pixel line memory 1222. The 
upper right new pixel data calculator 1219 subtracts the 
vertical correction value from the data of pixel of interest and 
adds the horizontal correction value, and output the data of 
new pixel to be interpolated to the upper new pixel line 
memory 1 222. The lower left new pixel data calculator 1220 
adds the vertical correction value to the data of the pixel of 
interest and subtracts the horizontal correction value, and 
ou t puts output the data of the n ew pixel to be interpolated to 
the lower new pixel line memory 1 223. The lower right new 
pixel data calculator 1221 adds the vertical correction value to 
the data of the pixel of interest and adds the horizontal 
correction value, and outputs output the data of the n e w pixel 
to be interpolated to the lower next pixel line memory 1 223. 

The upper new pixel line memory 1222 receives as its 
input the data from the upper left new pixel data calculator 
1218 and subsequently the data from the upper right new pixel 
data calculator 1219 by 1 pixel alternately, and stores the data 
of new pixel to be interpolated at the upper side of the pixel 
of interest for 1 line of the high-resolution image, and 
outputs o-u-t-p-u4- all of 1 line in the order of storing. The lower 
new pixel line memory 1 223 receives as its input the data from 
the lower left new pixel data calculator 1 220 and subsequently 
the data from the lower right new pixel data calculator 1221 
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by 1 pixel alternately, and stores the data of the n e w pixel to 
be interpolated at the lower side o f the p ixel of interest for 1 
line of high-resolution image, and outputs output all of 1 line 
in the order of storing, after the upper new pixel line memory 
12 2 2 outputs ou t r > u t the data of 1 line. 

Next, a calculation procedure of the arithmetic means 
1 23 3 will be described byw44fr referring to figure 8. 

Figure 8 is a flow chart showing a calculation procedure 
for performing resolution conversion from horizontal 3200x 
vertical 240 pixels to horizontal 640 x vertical 480 pixels 
b y w i t h interpolating to twice the n umber of pixels in both of 
the horizontal and vertical directions in the image processor 
according to the second embodiment of the present invention. 

In figure 8, difx is a horizontal correction value, dify is 
a vertical correction value, and k, 1, Q, P are the same as 
those in figure 1, and there are relations of 0< = k<320, 
0<1 <240. 

5801 denotes a vertical loop default initial setting up 
step for setting an initial value to a variable related to a 
vertical loop, which assigns an. initial value 0 to the vertical 
loop counter 1 . 

5802 denotes a horizontal loop default initial setting up 
step for setting an initial value to a variable related to a 
horizontal loop, which assigns an i nitial value 0 to the 
horizontal loop counter k. 
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5803 denotes a correction value calculating step for 
calculating a correction value in both the horizontal and 
vertical directions d-k^e-t-io-n-, which obtains the horizontal 
correction value difx and the vertical correction value dify by 
calculating difx =(P [k+l,l]-P [k-l,l]/8, dify = (P[k, 1+1]-P[k,l- 
1 ])/8, respectively. 

5804 denotes an a- intensity calculating step for 
calculating the intensity of four new pixels, and the intensity 
of the new pixel for interpolation to the upper left of the pixel 
of interest Q [ 2 k , 2 1 ] , the intensity of the n ew pixel for 
interpolation to the upper right of the p ixel of interest 
Q[2k-H,21], the intensity of the new pixel for interpolation to 
the lower left of the p ixel of interest Q [ 2 k , 2 1 + 1 ] , and the 
intensity of the new pixel for interpolation at the lower right 
of the pixel of interest Q[2k+l,21] by calculating 
Q[2k,21] = P[k,l]-difx-dify, Q [2 k+ 1 , 2 1] = P [ k , 1] + d i f x- d i fy , 
Q[2k,21+1 ]==P[k,l]-difx + dify, Q[2k+ 1 ,21+1 ] = P[k, l] + difx + dify 
respectively. 

5805 denotes a horizontal loop conclusion judging step 

for judging the conclusion of a h orizontal loop which 

comprises repeating steps s tep S803 through S 8 0 5 , which 
compares new horizontal loop counter k which is obtained by 
adding 1 to the horizontal loop counter k with the number of 

pixels 320 in the horizontal direction of a low-resolution 

image, and according to the result, it proceeds to step S803-4-n- 
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when the n ew horizontal loop counter k is smaller than 320 
while it proceeds to step S806 when it is equal to 320. 

S806 denotes a vertical loop conclusion judging step for 
judging the conclusion of a vertical loop which comprises 
repeating steps s tep S802 through S806, which compares new 
vertical loop counter 1 which is obtained by adding 1 to the 
vertical loop counter I with the number of pixels 240 in the 
vertical direction of a__low- resolution image, and according to 
the result, it proceeds to step S 802 when new vertical loop 
counter 1 is smaller than 240 while it terminates pixel 
interpolation of an image when where it is equal to 240. 

The new pixel data Q [2k, 21], Q [2 k+ 1 ,21], Q [2k, 21 + 1] 
and Q [2k+l,21+l] which are obtained by the above-described 
operation will be transferred to the upper new pixel line 
memory 1 222 in the order of Q[2k,21] , Q[2k+l,21], and 
transferred to the lower new pixel line memory 1 223 in the 
order of Q [2 k,2 1+ 1 ] , Q[2k+1 ,21 + 1]. 

In the image processor according to the second 
embodiment of the present invention, the image processor for 
converting a_low-resol ut ion image to a hi gh-resol ution image 
having twice the n umber of pixels in both the vertical and 
horizontal directions includes a pixel selection means 1130 for 
extracting a pixel of interest, an upper pixel, a lower pixel, a 
left pixel, and a right pixel, the vertical subtracter 1115 for 
calculating the difference in the vertical direction based upon 
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the data of the u p p e r and the 1 ower pixel, the horizontal 
subtracter 1114 for calculating the difference in the horizontal 
direction based upon the data of the left and the right pixel, 
the vertical arithmetic device 1117 for calculating the vertical 
correction value based upon the difference in the vertical 
direction and the distance from a pixel of interest to__a new 
pixel in the vertical direction, the horizontal arithmetic device 
1116 for calculating the horizontal correction value based 
upon the difference in the horizontal direction and the 

distance from a pixel of interest to t h__e n ew pixel in the 

horizontal direction, and the new pixel data calculator 1235 
for calculating the data of the n ew pixel which are positioned 
at an upper left, an upper right, a_lower left, and a_Jower right 
o f the p ixel of interest based upon the data of the p i x e 1 of 
interest, the vertical correction value, and the horizontal 
correction value, and the maintenance means 1234 for holding 
the data of the n ew pixel which is calculated by the new pixel 
data calculator 1 235 temporarily, and outputting the data 
sequentially from the upper left new pixel of h i gh - re s o 1 u t i o n 
image, and the position of the new pixel is made such that the 
absolute values of the distances from the pixel of interest are 
V 4 int-h-e- both the horizontal and vertical directions. This can 
improve the processing speed by reducing the operation 
amount b y vv i t h maintaining the appearance probability of the 
error of the pixel data as well as provide images with 
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sharpness without smoothing edge parts of the image. 
(Embodiment 3) 

The image processor according to a third embodiment is 
one which converts a low-resolution image of horizontal 
320xvertical 240 pixels pixel - to a high-resolution image of 
horizontal 320*vertical 480 pixels bv iweej — w44-h~ interpolating 
to twice the number of pixels in the vertical direction, which 
is used for image processing for generating a fra m e f I a m-e- 
screen by interpolating a field screen of an interlace signal 

such as an N TSC signal which is used for current TV 

broadcasting. 

Figure 13 is a block diagram showing a construction of 
the image processor according to the third embodiment. 

In figure 13, the same reference numerals denotes the 
same elements as in figure 11 or figure 12, 1 33 3 denotes a new 
pixel data arithmetic means, constructed as follows. 

Numerals To be specific - numerals 1115 and 1217 denotes 
the same elements in figure 11 or figure 12, 1318 denotes the 
upper new pixel data calculator for calculating the data of t h e 
new pixel for interpolation at the upper of the pixel of 
interest, 1320 denotes the lower new pixel data calculator for 
calculating the data of the n ew pixel for interpolation to the 
lower of the pixel of interest, 1 33 5 denotes a new pixel data 
calculator which is constituted by the upper new pixel data 
calculator 1318 and the lower new pixel data calculator 1320. 
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Further, in the pixel selection means 1 330 the image 
processor according to the third embodiment has a 
configuration having omitted the left pixel data buffer 1109 
and the left end processing path 1106 in the pixel selection 
means 1130 in figure 12. 

Figure 9 is a diagram illustrating the position of the 
new pixel which is interpolated by the image processor 
according to the third embodiment. 

In figure 9, " o " denotes an original pixel of a low- 
resolution image having a pixel interval being "1", "□" 
denotes a new pixel of a high-resolution image. Further, a 
new pixel matches the position of an o riginal pixel, and is 
positioned at a point which is distant from the original pixel 
in the vertical direction by 1/4. Have in the absolute value, 
the intensity of original pixels of 901, 902, 903 and new 
pixels of 904 and 905 are designated as P901, P902, P903, 
Q904 and Q905. 

According to this pixel arrangement, all the new pixels 
are arranged at equal intervals from the original pixels so as 
to make uniform the appearance probability of error of pixel 
data. 

Though a large calculation amount is required because it 
i s necessary n ece ssity to create all new pixels in the 
arrangement, by employing a similar devise as in the second 
embodiment of the present invention, the operation amount can 
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be suppressed. 

To be specific, if d ify = ( 1 /8)(P903 -P902) is first 
calculated on the basis of original pixels 901, 902, 903 the 
arithmetic expression for calculating the intensity of new 
pixels Q904, Q905 becomes as follows, 

Q904 = P90 1 -difx 

Q905 = P90 1 + difx 
and, a number of times required for calculating the intensity 
Q904 and Q905 of two new pixels from the intensity P901 of 
the p ixel of interest are three times addition or subtraction 
and one division. 

Hereinafter, an operation of new pixel data arithmetic 
means 1333 will be described. 

The vertical subtracter 1115 receives as its input the 
lower pixel data from the lower pixel data buffer 1111, and the 
upper pixel data from the upper pixel data buffer 1113, and 
subtracts the upper pixel data from the lower pixel data, and 
outp ut sou t p u -t- the difference in the vertical direction to the 
vertical arithmetic device 1217. The vertical arithmetic device 
1217 shifts the difference in the vertical direction leftward by 
3 bits to 1/8 and outputs output the vertical correction value to 
the upper new pixel data calculator 1318 and the lower new 
pixel data calculator 1 320. 

The upper new pixel data calculator 1318 receives as its 
inputs the vertical correction value from the vertical 
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arithmetic device 1217, and the data of pixel of interest from 
the pixel of interest data buffer 1108, and subtracts the 
vertical correction value from the data of the pixel of interest 
and o u t p u t s o u t p u t the data of the new pixel for interpolation 
at the upper of the p ixel of interest. The lower new pixel data 
calculator 1320 adds the vertical correction value to the data 
o f the p ixel of interest and outputs output the data of the n e w 
pixel to be interpolated at the lower of the pixel of interest to 
the lower new pixel line memory 1223. 

The upper new pixel line memory 1222 stores the data 
of the new pixel to be interpolated at the upper of the pixel of 
interest by 1 line of the high-resolution image, and 
outputs output all the 1 line in the order of storing. The lower 
new pixel line memory 1 223 stores the data of the new pixel to 
be interpolated at the lower of the pixel of interest by 1 line 
of high-resolution image, and outputs output all the 1 line in 
the order of storing, after the upper new pixel line memory 
12 2 2 o u t p u t s e-tt4-p-u-tr the data of 1 line. 

Hereinafter, an operation procedure of the new pixel 
data arithmetic means 1 33 3 will be described. 

Figure 10 is a flow chart showing an operation 
procedure for performing resolution conversion of horizontal 
3200x vertical 240 pixels to horizontal 320 x vertical 480 
pixels bvw-f-rt- interpolating to twice the number of pixels in 
the vertical direction in the image processor according to the 
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third embodiment of the present invention. 

In figure 10, dify, k, 1, Q, P denotes the same elements 
as those in figure 1 or figure 8, and there are relations of 
0<k<320, 0<1<240. 

51001 denotes a vertical loop default setting up step for 
setting the initial value to a variable related to the vertical 
loop, which assigns the initial value 0 to the vertical loop 
counter 1. 

51002 denotes a_h orizontal loop default setting up step 
for setting the initial value to a variable related to the 
horizontal loop, which assigns the initial value 0 to the 
horizontal loop counter k. 

51003 denotes a correction value calculating step for 
obtaining the correction value in the vertical direction, the 
vertical correction value dify is calculated by o dify = (P[k, 
l+l]-P[k,l-l])/8. 

51004 denotes an a- intensity calculating step for 
obtaining the intensity of two new pixels, which calculates the 
intensity Q[k,21] of the n ew pixel to be interpolated at the 
upper side of the pixel of interest and the intensity Q[k,21+1] 
o f the n ew pixel to be interpolated at the lower side of the 
pixel of interest by Q[k,21] = P[kJ]-dify and 
Q[k,2I + l] = P[kJ]+dify respectively. 

S 1 005 denotes a horizontal loop conclusion judging step 
for judging the conclusion of horizontal loop repeating 
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steps s4-ep- S1003 through S1005, and it compares new 
horizontal loop counter k obtained by adding 1 to the 
horizontal loop counter k with the number of pixels 320 in the 
horizontal direction of low-resolution image, and according to 
the result, it proceeds to step S 1 003 when where new 
horizontal loop counter k is smaller than 320 while it proceeds 
to step S1006 when it is equal to 320. 

S1006 denotes a vertical loop conclusion judging step 
for judging the end of vertical loop repeating steps s 4 e p SI 002 
through S1 006, and it compares new vertical loop counter 1 
obtained by adding 1 to the vertical loop counter 1 with the 
number of pixels 240 in the vertical direction of low- 
resolution image, and according to the result, it proceeds to 
step S1002 when new vertical loop counter 1 is smaller than 
240 while it terminates a pixel interpolation of an image when 
it is equal to 240. 

New pixel data Q[k,21] and Q[k,21+1] are calculated by 
the above-mentioned operation procedure, and Q[k,21] is 
transferred to the upper new pixel line memory 1 222 and 
Q[k,21-M] is transferred to the lower new pixel line memory 
1223. 

Accordingly, in the image processor according to the 
third embodiment of the present invention, the image 
processor for converting a low-resolution image to a high- 
resolution image having twice the n umber of pixels in the 
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vertical direction includes a pixel selection means 1 330 for 
extracting a pixel of interest, an upper pixel, and a lower 
pixel, the vertical subtracter 1115 for obtaining the difference 
in the vertical direction on the basis of the data of an upper 

and a lower pixel, the vertical arithmetic device 1217 for 

calculating the vertical correction value on the basis of the 
difference in the vertical direction and the distance from a 
pixel of interest to the new pixel in the vertical direction, the 
new pixel data calculator 1 33 5 for calculating the data of new 
pixel which are positioned at the upper side a nd the lower side 
o f the p ixel of interest on the basis of the data of the p i x e 1 of 
interest and the vertical correction value, and the maintenance 
means 1234 for holding the data of the new pixel which is 
calculated by the new pixel data calculator 1 33 5 temporarily 
and outputting the data sequentially from the upper left new 
pixel of high-resolution image, and the position of the n e w 
pixel is made such that the absolute value of the distance from 
the pixel of interest in the vertical direction is 1/4, thereby 
improving processing speed b v w i t h making uniform the 
appearance ratio of error of the pixel data and further 
reducing the amount of calculation, as well as obtaining aa-n- 
high-quality image with sharpness without edge parts of the 
image being smoothed . 

Though in the above first to third embodiments a pixel 
data is assumed to be only intensity data ,the pixel data may 
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be color data or color difference date of RGB, GMYK, and the 
like ,with the same effect described above be i ng w obtained. 

Further, in the first to third embodiments^ an image 
processor and an image processing method as an operation 
flowchart are described, but these can be realized by a 
computer program which is recorded in a recording medium 
such as ROM, and operates similarly as the image processing 
method in the first to third embodiments with the same effects 
obtained . 

APPLICABILITY IN INDUSTRY 

As mentioned above, the image processor, the image 
processing method and the image processing program recording 
medium according to the present invention can obtain ^.high- 
quality image with sharpness in spite of requiring a 
reduced less- amount of interpolation arithmetic to increase an 
image resolution, short processing time and small scale 
hardware, and further, it is possible to make uniform the 
appearance probability of error bx 0 ^ 1 employing a pixel data 
havin gwhe n a pixel arrangement which minimizes the 
arithmetic operation amount. 
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Abstract 

In an image processor, an image processing method, and 
an image processing program recording m e d i u m—ae-e-e-r-d-in g — H> 

t-h-^ — p r e s e n t — invention , an i n t e n s i t y — F- o f a n e w pixel is 

calculated by a formu la o f F - A+(i/2)(E D) + (j/2)(C B) on the 
basis of an intensitv-^V of a pixel of i n te r e st-~3-0~§~, an intensity 
6- of an original pixel 202 adjacent at an upper side of t he a- 
pixel of i nterest--3-0-5-, an intensity G— of an original pixel-3-0-8- 

adjacent at a lower side of the a- pixel of interest- 2-0-5-, an 

intensity-D- of an original pixel~24M- adjacent at a_Jeft side of 
thea- pixel of interest — 20 5 , and an intensity— & of an original 
pixel 206 adjacent at the right side of the a- pixel of interest 

In t h e s e — image — processor, — image processing method 

a-n-d HH-a-g-e p- t i^>^e-s-s4-ft-g ^.f-e^a-m- r^^-e-r-d-i-H-g rhhI-m , i -fc- — 

p-e-frs i b 1 e t-e reduce — t-h-e — opera ti on amo u nt — t-e i m prove 

p r e ce ss i n g — speed. — a-ft-d — further, — obtain — a-n — high - quality — i m a g e 
v^H4-&-^h-a~*^p^ e ss, in p e rfor ming conversion low - r e sol ution image 
to high - reso l ution im a ge : 
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